Multifunction device with integrated search and application selection

ABSTRACT

In some embodiments, a multifunction device with a touch screen display and a plurality of applications concurrently displays a first plurality of application launch icons in a first area of the touch screen display, detects a first input by a user, and in response to detecting the first input by the user, displays a search input area on the touch screen display. In some embodiments, the device receives search input from the user, performs a search using the search input, and displays a plurality of search results from the search. In some embodiments, the device detects user selection of a first search result in the plurality of search results, and displays information corresponding to the first search result in the corresponding first application. In some embodiments, in response input from the user, the device returns to the search results and repeats this process for one or more applications.

RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/167,516, filed May 27, 2016, which is a continuation of U.S.application Ser. No. 14/081,975, filed Nov. 15, 2013, now U.S. Pat. No.9,354,811, which is a continuation of U.S. application Ser. No.12/566,640, filed Sep. 24, 2009, now U.S. Pat. No. 8,589,374, whichclaims priority to U.S. Provisional Patent Application No. 61/210,335,titled “Multifunction Device with Integrated Search and ApplicationSelection,” filed Mar. 16, 2009, which are incorporated by referenceherein in their entirety.

TECHNICAL FIELD

The disclosed embodiments relate generally to electronic devices withtouch-sensitive surfaces operable to access multiple applications andperform searches over information associated with those applications.

BACKGROUND

The use of touch-sensitive surfaces as input devices for computers andother electronic computing devices has increased significantly in recentyears. Exemplary touch-sensitive surfaces include touch pads and touchscreen displays. Electronic computing devices such as portablemultifunction devices often contain information associated with aplurality of applications. Users of portable multifunction devices oftenuse search functions to find information on the portable multifunctiondevice. For example, a user may need to find information on a contact,including the phone number of the contact and an appointment with thecontact and any documents associated with the contact. Once the user hasreceived results that correspond to the search, the user often wantsfull access to the application that is associated with a search result,and then often wants to return to the search results.

But conventional methods for performing these searches are cumbersomeand inefficient. For example, using a search that requires the user toseparately perform a search for each application is tedious and createsa significant cognitive burden on a user. Similarly, using a search thatdoes not provide the user with full access to the application when theuser selects a result or does not allow the user to easily return to thelist of results is also tedious and creates a significant cognitiveburden on a user. In addition, conventional methods take longer thannecessary, thereby wasting energy. This latter consideration isparticularly important in battery-operated devices.

Accordingly, there is a need for multifunction devices with faster, moreefficient methods and interfaces for search. Such methods and interfacesreduce the cognitive burden on a user and produce a more efficienthuman-machine interface. For battery-operated multifunction devices,such methods and interfaces conserve power and increase the time betweenbattery charges.

SUMMARY

The above deficiencies and other problems associated with userinterfaces for multifunction devices with touch-sensitive surfaces arereduced or eliminated by the disclosed devices. In some embodiments, thedevice is a desktop computer. In some embodiments, the device isportable (e.g., a notebook computer or handheld device). In someembodiments, the device has a touchpad. In some embodiments, the devicehas a touch-sensitive display (also known as a “touch screen” or “touchscreen display”). In some embodiments, the device has a graphical userinterface (GUI), one or more processors, memory and one or more modules,programs or sets of instructions stored in the memory for performingmultiple functions. In some embodiments, the user interacts with the GUIprimarily through finger contacts and gestures on the touch-sensitivesurface. In some embodiments, the functions may include image editing,drawing, presenting, word processing, website creating, disk authoring,spreadsheet making, game playing, telephoning, video conferencing,e-mailing, instant messaging, workout support, digital photographing,digital videoing, web browsing, digital music playing, and/or digitalvideo playing. Executable instructions for performing these functionsmay be included in a computer readable storage medium or other computerprogram product configured for execution by one or more processors.

In accordance with some embodiments, a method is performed at amultifunction device with a display and a touch-sensitive surface. Themethod includes: concurrently displaying a first plurality ofapplication launch icons in a first area of the touch screen display;detecting a first input by a user; in response to detecting the firstinput by the user, displaying a search input area on the touch screendisplay; receiving search input from the user; displaying the searchinput on the touch screen display; performing a search using the searchinput; displaying a plurality of search results from the search on thetouch screen display; detecting user selection of a first search resultin the plurality of search results, wherein the first search resultcorresponds to content associated with a first application; in responseto detecting user selection of the first search result in the pluralityof search results: ceasing to display of the plurality of searchresults, and displaying information corresponding to the first searchresult in the corresponding first application; while continuing todisplay the first application, detecting a second input by the user inresponse to detecting the second input by the user: ceasing to displaythe first application, and redisplaying the plurality of search resultson the touch screen display; detecting user selection of a second searchresult in the plurality of search results, wherein the second searchresult corresponds to content associated with a second application, thesecond search result is other than the first search result, and thesecond application is other than the first application; in response todetecting user selection of the second search result in the plurality ofsearch results: ceasing to display of the plurality of search results,and displaying information corresponding to the second search result inthe corresponding second application; while continuing to display thesecond application, detecting a third input by the user in response todetecting the third input by the user: ceasing to display the secondapplication, and redisplaying the plurality of search results on thetouch screen display.

In accordance with some embodiments, a multifunction device includes atouch-sensitive surface, a display, one or more processors, memory, andone or more programs. The one or more programs are stored in the memoryand configured to be executed by the one or more processors. The one ormore programs include instructions for: concurrently displaying a firstplurality of application launch icons in a first area of the touchscreen display; detecting a first input by a user; in response todetecting the first input by the user, displaying a search input area onthe touch screen display; receiving search input from the user;displaying the search input on the touch screen display; performing asearch using the search input; displaying a plurality of search resultsfrom the search on the touch screen display; detecting user selection ofa first search result in the plurality of search results, wherein thefirst search result corresponds to content associated with a firstapplication; in response to detecting user selection of the first searchresult in the plurality of search results: ceasing to display of theplurality of search results, and displaying information corresponding tothe first search result in the corresponding first application; whilecontinuing to display the first application, detecting a second input bythe user in response to detecting the second input by the user: ceasingto display the first application, and redisplaying the plurality ofsearch results on the touch screen display; detecting user selection ofa second search result in the plurality of search results, wherein thesecond search result corresponds to content associated with a secondapplication, the second search result is other than the first searchresult, and the second application is other than the first application;in response to detecting user selection of the second search result inthe plurality of search results: ceasing to display of the plurality ofsearch results, and displaying information corresponding to the secondsearch result in the corresponding second application; while continuingto display the second application, detecting a third input by the user:in response to detecting the third input by the user: ceasing to displaythe second application, and redisplaying the plurality of search resultson the touch screen display.

In accordance with some embodiments, a computer readable storage mediumhas stored therein instructions which when executed by a multifunctiondevice with a touch-sensitive surface and a display, cause the deviceto: concurrently display a first plurality of application launch iconsin a first area of the touch screen display; detect a first input by auser; in response to detecting the first input by the user, display asearch input area on the touch screen display; receive search input fromthe user; display the search input on the touch screen display; performa search using the search input; display a plurality of search resultsfrom the search on the touch screen display; detect user selection of afirst search result in the plurality of search results, wherein thefirst search result corresponds to content associated with a firstapplication; in response to detecting user selection of the first searchresult in the plurality of search results: cease to display of theplurality of search results, and display information corresponding tothe first search result in the corresponding first application; whilecontinuing to display the first application, detect a second input bythe user in response to detecting the second input by the user: cease todisplay the first application, and redisplay the plurality of searchresults on the touch screen display; detect user selection of a secondsearch result in the plurality of search results, wherein the secondsearch result corresponds to content associated with a secondapplication, the second search result is other than the first searchresult, and the second application is other than the first application;in response to detecting user selection of the second search result inthe plurality of search results: cease to display of the plurality ofsearch results, and display information corresponding to the secondsearch result in the corresponding second application; while continuingto display the second application, detect a third input by the user: inresponse to detecting the third input by the user: cease to display thesecond application, and redisplay the plurality of search results on thetouch screen display.

In accordance with some embodiments, a graphical user interface on amultifunction device with a touch-sensitive surface, a display, amemory, and one or more processors to execute one or more programsstored in the memory includes a search input area; a plurality ofapplications; and a plurality of application icons wherein: a firstinput by a user is detected; in response to detecting the first input bythe user, the search input area is displayed on the touch screendisplay; search input is received from the user; the search input isdisplayed on the touch screen display; perform a search using the searchinput; a plurality of search results from the search on the touch screendisplay are displayed; user selection of a first search result in theplurality of search results is detected, wherein the first search resultcorresponds to content associated with a first application; in responseto detecting user selection of the first search result in the pluralityof search results: display of the plurality of search results is ceased,and information corresponding to the first search result in thecorresponding first application is displayed; while continuing todisplay the first application, a second input by the user is detected:in response to detecting the second input by the user: display of thefirst application is ceased, and the plurality of search results on thetouch screen display are redisplayed; user selection of a second searchresult in the plurality of search results is detected, wherein thesecond search result corresponds to content associated with a secondapplication, the second search result is other than the first searchresult, and the second application is other than the first application;in response to detecting user selection of the second search result inthe plurality of search results: display of the plurality of searchresults is ceased, and information corresponding to the second searchresult in the corresponding second application is displayed; whilecontinuing to display the second application, a third input by the userus detected: in response to detecting the third input by the user:display of the second application is ceased, and the plurality of searchresults on the touch screen display is redisplayed.

In accordance with some embodiments, a multifunction device includes: atouch-sensitive surface; a display; means for concurrently displaying afirst plurality of application launch icons in a first area of the touchscreen display; means for detecting a first input by a user; means for,in response to detecting the first input by the user, displaying asearch input area on the touch screen display; means for receivingsearch input from the user; means for displaying the search input on thetouch screen display; means for performing a search using the searchinput; means for displaying a plurality of search results from thesearch on the touch screen display; means for detecting user selectionof a first search result in the plurality of search results, wherein thefirst search result corresponds to content associated with a firstapplication; in response to detecting user selection of the first searchresult in the plurality of search results: means for ceasing to displayof the plurality of search results, and means for displaying informationcorresponding to the first search result in the corresponding firstapplication; means for, while continuing to display the firstapplication, detecting a second input by the user in response todetecting the second input by the user: means for ceasing to display thefirst application, and means for redisplaying the plurality of searchresults on the touch screen display; means for detecting user selectionof a second search result in the plurality of search results, whereinthe second search result corresponds to content associated with a secondapplication, the second search result is other than the first searchresult, and the second application is other than the first application;in response to detecting user selection of the second search result inthe plurality of search results: means for ceasing to display of theplurality of search results, and means for displaying informationcorresponding to the second search result in the corresponding secondapplication; means for, while continuing to display the secondapplication, detecting a third input by the user: in response todetecting the third input by the user: means for ceasing to display thesecond application, and means for redisplaying the plurality of searchresults on the touch screen display.

Thus, multifunction devices with touch-sensitive surfaces are providedwith faster, more efficient methods and interfaces operable to performintegrated searches and provide access to a plurality of applications,thereby increasing the effectiveness, efficiency, and user satisfactionwith such devices.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the aforementioned embodiments of theinvention as well as additional embodiments thereof, reference should bemade to the Description of Embodiments below, in conjunction with thefollowing drawings in which like reference numerals refer tocorresponding parts throughout the figures.

FIGS. 1A and 1B are block diagrams illustrating portable multifunctiondevices with touch-sensitive displays in accordance with someembodiments.

FIG. 2 illustrates a portable multifunction device having a touch screenin accordance with some embodiments.

FIG. 3 is a block diagram of an exemplary multifunction device with adisplay and a touch-sensitive surface in accordance with someembodiments.

FIGS. 4A and 4B illustrate exemplary user interfaces for a menu ofapplications on a portable multifunction device in accordance with someembodiments.

FIGS. 5A-5Y illustrate exemplary user interfaces for performingintegrated searches and accessing data associated with a plurality ofapplications in accordance with some embodiments.

FIGS. 6A-6K are flow diagrams illustrating a method for performingintegrated searches and accessing data associated with a plurality ofapplications in accordance with some embodiments.

DESCRIPTION OF EMBODIMENTS

Reference will now be made in detail to embodiments, examples of whichare illustrated in the accompanying drawings. In the following detaileddescription, numerous specific details are set forth in order to providea thorough understanding of the present invention. However, it will beapparent to one of ordinary skill in the art that the present inventionmay be practiced without these specific details. In other instances,well-known methods, procedures, components, circuits, and networks havenot been described in detail so as not to unnecessarily obscure aspectsof the embodiments.

It will also be understood that, although the terms first, second, etc.may be used herein to describe various elements, these elements shouldnot be limited by these terms. These terms are only used to distinguishone element from another. For example, a first contact could be termed asecond contact, and, similarly, a second contact could be termed a firstcontact, without departing from the scope of the present invention. Thefirst contact and the second contact are both contacts, but they are notthe same contact.

The terminology used in the description of the invention herein is forthe purpose of describing particular embodiments only and is notintended to be limiting of the invention. As used in the description ofthe invention and the appended claims, the singular forms “a”, “an” and“the” are intended to include the plural forms as well, unless thecontext clearly indicates otherwise. It will also be understood that theterm “and/or” as used herein refers to and encompasses any and allpossible combinations of one or more of the associated listed items. Itwill be further understood that the terms “comprises” and/or“comprising,” when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof.

As used herein, the term “if’ may be construed to mean “when” or “upon”or “in response to determining” or “in response to detecting,” dependingon the context. Similarly, the phrase “if it is determined” or “if [astated condition or event] is detected” may be construed to mean “upondetermining” or “in response to determining” or “upon detecting [thestated condition or event]” or “in response to detecting [the statedcondition or event],” depending on the context.

Embodiments of computing devices, user interfaces for such devices, andassociated processes for using such devices are described. In someembodiments, the computing device is a portable communications devicesuch as a mobile telephone that also contains other functions, such asPDA and/or music player functions. Exemplary embodiments of portablemultifunction devices include, without limitation, the iPhone® and iPodTouch® devices from Apple Computer, Inc. of Cupertino, Calif.

In the discussion that follows, a multifunction device that includes adisplay and a touch-sensitive surface is described. It should beunderstood, however, that the multifunction device may include one ormore other physical user-interface devices, such as a physical keyboard,a mouse and/or a joystick.

The device supports a variety of applications, such as one or more ofthe following: a drawing application, a presentation application, a wordprocessing application, a website creation application, a disk authoringapplication, a spreadsheet application, a gaming application, atelephone application, a video conferencing application, an e-mailapplication, an instant messaging application, a workout supportapplication, a photo management application, a digital cameraapplication, a digital video camera application, a web browsingapplication, a digital music player application, and/or a digital videoplayer application.

The various applications that may be executed on the device may use atleast one common physical user-interface device, such as thetouch-sensitive surface. One or more functions of the touch-sensitivesurface as well as corresponding information displayed on the device maybe adjusted and/or varied from one application to the next and/or withina respective application. In this way, a common physical architecture(such as the touch-sensitive surface) of the device may support thevariety of applications with user interfaces that are intuitive andtransparent.

The user interfaces may include one or more soft keyboard embodiments.The soft keyboard embodiments may include standard (QWERTY) and/ornon-standard configurations of symbols on the displayed icons of thekeyboard, such as those described in U.S. patent application Ser. No.11/459,606, “Keyboards For Portable Electronic Devices,” filed Jul. 24,2006, and Ser. No. 11/459,615, “Touch Screen Keyboards For PortableElectronic Devices,” filed Jul. 24, 2006, the contents of which arehereby incorporated by reference in their entirety. The keyboardembodiments may include a reduced number of icons (or soft keys)relative to the number of keys in existing physical keyboards, such asthat for a typewriter. This may make it easier for users to select oneor more icons in the keyboard, and thus, one or more correspondingsymbols. The keyboard embodiments may be adaptive. For example,displayed icons may be modified in accordance with user actions, such asselecting one or more icons and/or one or more corresponding symbols.One or more applications on the device may utilize common and/ordifferent keyboard embodiments. Thus, the keyboard embodiment used maybe tailored to at least some of the applications. In some embodiments,one or more keyboard embodiments may be tailored to a respective user.For example, one or more keyboard embodiments may be tailored to arespective user based on a word usage history (lexicography, slang,individual usage) of the respective user. Some of the keyboardembodiments may be adjusted to reduce a probability of a user error whenselecting one or more icons, and thus one or more symbols, when usingthe soft keyboard embodiments.

Attention is now directed towards embodiments of portable devices withtouch-sensitive displays. FIGS. 1A and 1B are block diagramsillustrating portable multifunction devices 100 with touch-sensitivedisplays 112 in accordance with some embodiments. The touch-sensitivedisplay 112 is sometimes called a “touch screen” for convenience, andmay also be known as or called a touch-sensitive display system. Thedevice 100 may include a memory 102 (which may include one or morecomputer readable storage mediums), a memory controller 122, one or moreprocessing units (CPU's) 120, a peripherals interface 118, RF circuitry108, audio circuitry 110, a speaker 111, a microphone 113, aninput/output (110) subsystem 106, other input or control devices 116,and an external port 124. The device 100 may include one or more opticalsensors 164. These components may communicate over one or morecommunication buses or signal lines 103.

It should be appreciated that the device 100 is only one example of aportable multifunction device 100, and that the device 100 may have moreor fewer components than shown, may combine two or more components, or amay have a different configuration or arrangement of the components. Thevarious components shown in FIGS. 1A and 1B may be implemented inhardware, software, or a combination of both hardware and software,including one or more signal processing and/or application specificintegrated circuits.

Memory 102 may include high-speed random access memory and may alsoinclude non-volatile memory, such as one or more magnetic disk storagedevices, flash memory devices, or other non-volatile solid-state memorydevices. Access to memory 102 by other components of the device 100,such as the CPU 120 and the peripherals interface 118, may be controlledby the memory controller 122.

The peripherals interface 118 couples the input and output peripheralsof the device to the CPU 120 and memory 102. The one or more processors120 run or execute various software programs and/or sets of instructionsstored in memory 102 to perform various functions for the device 100 andto process data.

In some embodiments, the peripherals interface 118, the CPU 120, and thememory controller 122 may be implemented on a single chip, such as achip 104. In some other embodiments, they may be implemented on separatechips.

The RF (radio frequency) circuitry 108 receives and sends RF signals,also called electromagnetic signals. The RF circuitry 108 convertselectrical signals to/from electromagnetic signals and communicates withcommunications networks and other communications devices via theelectromagnetic signals. The RF circuitry 108 may include well-knowncircuitry for performing these functions, including but not limited toan antenna system, an RF transceiver, one or more amplifiers, a tuner,one or more oscillators, a digital signal processor, a CODEC chipset, asubscriber identity module (SIM) card, memory, and so forth. The RFcircuitry 108 may communicate with networks, such as the Internet, alsoreferred to as the World Wide Web (WWW), an intranet and/or a wirelessnetwork, such as a cellular telephone network, a wireless local areanetwork (LAN) and/or a metropolitan area network (MAN), and otherdevices by wireless communication. The wireless communication may useany of a plurality of communications standards, protocols andtechnologies, including but not limited to Global System for MobileCommunications (GSM), Enhanced Data GSM Environment (EDGE), high-speeddownlink packet access (HSDPA), wideband code division multiple access(W-CDMA), code division multiple access (CDMA), time division multipleaccess (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a,IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), voice over InternetProtocol (VoIP), Wi-MAX, a protocol for email (e.g., Internet messageaccess protocol (IMAP) and/or post office protocol (POP)), instantmessaging (e.g., extensible messaging and presence protocol (XMPP),Session Initiation Protocol for Instant Messaging and PresenceLeveraging Extensions (SIMPLE), Instant Messaging and Presence Service(IMPS)), and/or Short Message Service (SMS)), or any other suitablecommunication protocol, including communication protocols not yetdeveloped as of the filing date of this document.

The audio circuitry 110, the speaker 111, and the microphone 113 providean audio interface between a user and the device 100. The audiocircuitry 110 receives audio data from the peripherals interface 118,converts the audio data to an electrical signal, and transmits theelectrical signal to the speaker 111. The speaker 111 converts theelectrical signal to human-audible sound waves. The audio circuitry 110also receives electrical signals converted by the microphone 113 fromsound waves. The audio circuitry 110 converts the electrical signal toaudio data and transmits the audio data to the peripherals interface 118for processing. Audio data may be retrieved from and/or transmitted tomemory 102 and/or the RF circuitry 108 by the peripherals interface 118.In some embodiments, the audio circuitry 110 also includes a headsetjack (e.g. 212, FIG. 2). The headset jack provides an interface betweenthe audio circuitry 110 and removable audio input/output peripherals,such as output-only headphones or a headset with both output (e.g., aheadphone for one or both ears) and input (e.g., a microphone).

The I/O subsystem 106 couples input/output peripherals on the device100, such as the touch screen 112 and other input/control devices 116,to the peripherals interface 118. The I/O subsystem 106 may include adisplay controller 156 and one or more input controllers 160 for otherinput or control devices. The one or more input controllers 160receive/send electrical signals from/to other input or control devices116. The other input/control devices 116 may include physical buttons(e.g., push buttons, rocker buttons, etc.), dials, slider switches,joysticks, click wheels, and so forth. In some alternate embodiments,input controller(s) 160 may be coupled to any (or none) of thefollowing: a keyboard, infrared port, USB port, and a pointer devicesuch as a mouse. The one or more buttons (e.g., 208, FIG. 2) may includean up/down button for volume control of the speaker 111 and/or themicrophone 113. The one or more buttons may include a push button (e.g.,206, FIG. 2). A quick press of the push button may disengage a lock ofthe touch screen 112 or begin a process that uses gestures on the touchscreen to unlock the device, as described in U.S. patent applicationSer. No. 11/322,549, “Unlocking a Device by Performing Gestures on anUnlock Image,” filed Dec. 23, 2005, which is hereby incorporated byreference in its entirety. A longer press of the push button (e.g., 206)may turn power to the device 100 on or off. The user may be able tocustomize a functionality of one or more of the buttons. The touchscreen 112 is used to implement virtual or soft buttons and one or moresoft keyboards.

The touch-sensitive touch screen 112 provides an input interface and anoutput interface between the device and a user. The display controller156 receives and/or sends electrical signals from/to the touch screen112. The touch screen 112 displays visual output to the user. The visualoutput may include graphics, text, icons, video, and any combinationthereof (collectively termed “graphics”). In some embodiments, some orall of the visual output may correspond to user-interface objects.

A touch screen 112 has a touch-sensitive surface, sensor or set ofsensors that accepts input from the user based on haptic and/or tactilecontact. The touch screen 112 and the display controller 156 (along withany associated modules and/or sets of instructions in memory 102) detectcontact (and any movement or breaking of the contact) on the touchscreen 112 and converts the detected contact into interaction withuser-interface objects (e.g., one or more soft keys, icons, web pages orimages) that are displayed on the touch screen. In an exemplaryembodiment, a point of contact between a touch screen 112 and the usercorresponds to a finger of the user.

The touch screen 112 may use LCD (liquid crystal display) technology, orLPD (light emitting polymer display) technology, although other displaytechnologies may be used in other embodiments. The touch screen 112 andthe display controller 156 may detect contact and any movement orbreaking thereof using any of a plurality of touch sensing technologiesnow known or later developed, including but not limited to capacitive,resistive, infrared, and surface acoustic wave technologies, as well asother proximity sensor arrays or other elements for determining one ormore points of contact with a touch screen 112. In an exemplaryembodiment, projected mutual capacitance sensing technology is used,such as that found in the iPhone® and iPod Touch® from Apple Computer,Inc. of Cupertino, Calif.

A touch-sensitive display in some embodiments of the touch screen 112may be analogous to the multi-touch sensitive tablets described in thefollowing U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat. No.6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932(Westerman), and/or U.S. Patent Publication 2002/0015024A1, each ofwhich is hereby incorporated by reference in its entirety. However, atouch screen 112 displays visual output from the portable device 100,whereas touch sensitive tablets do not provide visual output.

A touch-sensitive display in some embodiments of the touch screen 112may be as described in the following applications: (1) U.S. patentapplication Ser. No. 11/381,313, “Multipoint Touch Surface Controller,”filed May 2, 2006; (2) U.S. patent application Ser. No. 10/840,862,“Multipoint Touchscreen,” filed May 6, 2004; (3) U.S. patent applicationSer. No. 10/903,964, “Gestures For Touch Sensitive Input Devices,” filedJul. 30, 2004; (4) U.S. patent application Ser. No. 11/048,264,“Gestures For Touch Sensitive Input Devices,” filed Jan. 31, 2005; (5)U.S. patent application Ser. No. 11/038,590, “Mode-Based Graphical UserInterfaces For Touch Sensitive Input Devices,” filed Jan. 18, 2005; (6)U.S. patent application Ser. No. 11/228,758, “Virtual Input DevicePlacement On A Touch Screen User Interface,” filed Sep. 16, 2005; (7)U.S. patent application Ser. No. 11/228,700, “Operation Of A ComputerWith A Touch Screen Interface,” filed Sep. 16, 2005; (8) U.S. patentapplication Ser. No. 11/228,737, “Activating Virtual Keys Of ATouch-Screen Virtual Keyboard,” filed Sep. 16, 2005; and (9) U.S. patentapplication Ser. No. 11/367,749, “Multi-Functional Hand-Held Device,”filed Mar. 3, 2006. All of these applications are incorporated byreference herein in their entirety.

The touch screen 112 may have a resolution in excess of 100 dpi. In anexemplary embodiment, the touch screen has a resolution of approximately160 dpi. The user may make contact with the touch screen 112 using anysuitable object or appendage, such as a stylus, a finger, and so forth.In some embodiments, the user interface is designed to work primarilywith finger-based contacts and gestures, which are much less precisethan stylus-based input due to the larger area of contact of a finger onthe touch screen. In some embodiments, the device translates the roughfinger-based input into a precise pointer/cursor position or command forperforming the actions desired by the user.

In some embodiments, in addition to the touch screen, the device 100 mayinclude a touchpad (not shown) for activating or deactivating particularfunctions. In some embodiments, the touchpad is a touch-sensitive areaof the device that, unlike the touch screen, does not display visualoutput. The touchpad may be a touch-sensitive surface that is separatefrom the touch screen 112 or an extension of the touch-sensitive surfaceformed by the touch screen.

In some embodiments, the device 100 may include a physical or virtualclick wheel as an input control device 116. A user may navigate amongand interact with one or more graphical objects (e.g., icons) displayedin the touch screen 112 by rotating the click wheel or by moving a pointof contact with the click wheel (e.g., where the amount of movement ofthe point of contact is measured by its angular displacement withrespect to a center point of the click wheel). The click wheel may alsobe used to select one or more of the displayed icons. For example, theuser may press down on at least a portion of the click wheel or anassociated button. User commands and navigation commands provided by theuser via the click wheel may be processed by an input controller 160 aswell as one or more of the modules and/or sets of instructions in memory102. For a virtual click wheel, the click wheel and click wheelcontroller may be part of the touch screen 112 and the displaycontroller 156, respectively. For a virtual click wheel, the click wheelmay be either an opaque or semitransparent object that appears anddisappears on the touch screen display in response to user interactionwith the device. In some embodiments, a virtual click wheel is displayedon the touch screen of a portable multifunction device and operated byuser contact with the touch screen.

The device 100 also includes a power system 162 for powering the variouscomponents. The power system 162 may include a power management system,one or more power sources (e.g., battery, alternating current (AC)), arecharging system, a power failure detection circuit, a power converteror inverter, a power status indicator (e.g., a light-emitting diode(LED)) and any other components associated with the generation,management and distribution of power in portable devices.

The device 100 may also include one or more optical sensors 164. FIGS.1A and 1B show an optical sensor coupled to an optical sensor controller158 in I/O subsystem 106. The optical sensor 164 may includecharge-coupled device (CCD) or complementary metal-oxide semiconductor(CMOS) phototransistors. The optical sensor 164 receives light from theenvironment, projected through one or more lens, and converts the lightto data representing an image. In conjunction with an imaging module 143(also called a camera module), the optical sensor 164 may capture stillimages or video. In some embodiments, an optical sensor is located onthe back of the device 100, opposite the touch screen display 112 on thefront of the device, so that the touch screen display may be used as aviewfinder for still and/or video image acquisition. In someembodiments, an optical sensor is located on the front of the device sothat the user's image may be obtained for videoconferencing while theuser views the other video conference participants on the touch screendisplay. In some embodiments, the position of the optical sensor 164 canbe changed by the user (e.g., by rotating the lens and the sensor in thedevice housing) so that a single optical sensor 164 may be used alongwith the touch screen display for both video conferencing and stilland/or video image acquisition.

The device 100 may also include one or more proximity sensors 166. FIGS.1A and 1B show a proximity sensor 166 coupled to the peripheralsinterface 118. Alternately, the proximity sensor 166 may be coupled toan input controller 160 in the I/O subsystem 106. The proximity sensor166 may perform as described in U.S. patent application Ser. No.11/241,839, “Proximity Detector In Handheld Device”; Ser. No.11/240,788, “Proximity Detector In Handheld Device”; Ser. No.11/620,702, “Using Ambient Light Sensor To Augment Proximity SensorOutput”; Ser. No. 11/586,862, “Automated Response To And Sensing Of UserActivity In Portable Devices”; and Ser. No. 11/638,251, “Methods AndSystems For Automatic Configuration Of Peripherals,” which are herebyincorporated by reference in their entirety. In some embodiments, theproximity sensor turns off and disables the touch screen 112 when themultifunction device is placed near the user's ear (e.g., when the useris making a phone call). In some embodiments, the proximity sensor keepsthe screen off when the device is in the user's pocket, purse, or otherdark area to prevent unnecessary battery drainage when the device is alocked state.

The device 100 may also include one or more accelerometers 168. FIGS. 1Aand 1B show an accelerometer 168 coupled to the peripherals interface118. Alternately, the accelerometer 168 may be coupled to an inputcontroller 160 in the I/O subsystem 106. The accelerometer 168 mayperform as described in U.S. Patent Publication No. 20050190059,“Acceleration-based Theft Detection System for Portable ElectronicDevices,” and U.S. Patent Publication No. 20060017692, “Methods AndApparatuses For Operating A Portable Device Based On An Accelerometer,”both of which are which are incorporated by reference herein in theirentirety. In some embodiments, information is displayed on the touchscreen display in a portrait view or a landscape view based on ananalysis of data received from the one or more accelerometers.

In some embodiments, the software components stored in memory 102 mayinclude an operating system 126, a communication module (or set ofinstructions) 128, a contact/motion module (or set of instructions) 130,a graphics module (or set of instructions) 132, a text input module (orset of instructions) 134, a Global Positioning System (GPS) module (orset of instructions) 135, and applications (or set of instructions) 136.

The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X,WINDOWS, or an embedded operating system such as VxWorks) includesvarious software components and/or drivers for controlling and managinggeneral system tasks (e.g., memory management, storage device control,power management, etc.) and facilitates communication between varioushardware and software components.

The communication module 128 facilitates communication with otherdevices over one or more external ports 124 and also includes varioussoftware components for handling data received by the RF circuitry 108and/or the external port 124. The external port 124 (e.g., UniversalSerial Bus (USB), FIREWIRE, etc.) is adapted for coupling directly toother devices or indirectly over a network (e.g., the Internet, wirelessLAN, etc.). In some embodiments, the external port is a multi-pin (e.g.,30-pin) connector that is the same as, or similar to and/or compatiblewith the 30-pin connector used on iPod (trademark of Apple Computer,Inc.) devices.

The contact/motion module 130 may detect contact with the touch screen112 (in conjunction with the display controller 156) and other touchsensitive devices (e.g., a touchpad or physical click wheel). Thecontact/motion module 130 includes various software components forperforming various operations related to detection of contact, such asdetermining if contact has occurred (e.g., detecting a finger-downevent), determining if there is movement of the contact and tracking themovement across the touch-sensitive surface (e.g., detecting one or morefinger-dragging events), and determining if the contact has ceased(e.g., detecting a finger-up event or a break in contact). Thecontact/motion module 130 receives contact data from the touch-sensitivesurface. Determining movement of the point of contact, which isrepresented by a series of contact data, may include determining speed(magnitude), velocity (magnitude and direction), and/or an acceleration(a change in magnitude and/or direction) of the point of contact. Theseoperations may be applied to single contacts (e.g., one finger contacts)or to multiple simultaneous contacts (e.g., “multitouch”/multiple fingercontacts). In some embodiments, the contact/motion module 130 and thedisplay controller 156 detects contact on a touchpad. In someembodiments, the contact/motion module 130 and the controller 160detects contact on a click wheel.

The contact/motion module 130 may detect a gesture input by a user.Different gestures on the touch-sensitive surface have different contactpatterns. Thus, a gesture may be detected by detecting a particularcontact pattern. For example, detecting a finger tap gesture comprisesdetecting a finger-down event followed by detecting a finger-up event atthe same position (or substantially the same position) as thefinger-down event (e.g., at the position of an icon). As anotherexample, detecting a finger swipe gesture on the touch-sensitive surfacecomprises detecting a finger-down event followed by detecting one ormore finger-dragging events, and subsequently followed by detecting afinger-up event.

The graphics module 132 includes various known software components forrendering and displaying graphics on the touch screen 112 or otherdisplay, including components for changing the intensity of graphicsthat are displayed. As used herein, the term “graphics” includes anyobject that can be displayed to a user, including without limitationtext, web pages, icons (such as user-interface objects including softkeys), digital images, videos, animations and the like.

In some embodiments, the graphics module 132 stores data representinggraphics to be used. Each graphic may be assigned a corresponding code.The graphics module 132 receives, from applications etc., one or morecodes specifying graphics to be displayed along with, if necessary,coordinate data and other graphic property data, and then generatesscreen image data to output to display controller 156.

The text input module 134, which may be a component of graphics module132, provides soft keyboards for entering text in various applications(e.g., contacts 137, e-mail 140, IM 141, browser 147, and any otherapplication that needs text input).

The GPS module 135 determines the location of the device and providesthis information for use in various applications (e.g., to telephone 138for use in location-based dialing, to camera 143 as picture/videometadata, and to applications that provide location-based services suchas weather widgets, local yellow page widgets, and map/navigationwidgets).

The applications 136 may include the following modules (or sets ofinstructions), or a subset or superset thereof:

-   -   a contacts module 137 (sometimes called an address book or        contact list);    -   a telephone module 138;    -   a video conferencing module 139;    -   an e-mail client module 140;    -   an instant messaging (IM) module 141;    -   a workout support module 142;    -   a camera module 143 for still and/or video images;    -   an image management module 144;    -   a video player module 145;    -   a music player module 146;    -   a browser module 147;    -   a calendar module 148;    -   widget modules 149, which may include weather widget 149-1,        stocks widget 149-2, calculator widget 149-3, alarm clock widget        149-4, dictionary widget 149-5, and other widgets obtained by        the user, as well as user-created widgets 149-6;    -   widget creator module 150 for making user-created widgets 149-6;    -   search module 151;    -   video and music player module 152, which merges video player        module 145 and music player module 146;    -   notes module 153;    -   map module 154; and/or    -   online video module 155.

Examples of other applications 136 that may be stored in memory 102include other word processing applications, other image editingapplications, drawing applications, presentation applications,JAVA-enabled applications, encryption, digital rights management, voicerecognition, and voice replication.

In conjunction with touch screen 112, display controller 156, contactmodule 130, graphics module 132, and text input module 134, the contactsmodule 137 may be used to manage an address book or contact list,including: adding name(s) to the address book; deleting name(s) from theaddress book; associating telephone number(s), e-mail address(es),physical address(es) or other information with a name; associating animage with a name; categorizing and sorting names; providing telephonenumbers or e-mail addresses to initiate and/or facilitate communicationsby telephone 138, video conference 139, e-mail 140, or IM 141; and soforth.

In conjunction with RF circuitry 108, audio circuitry 110, speaker 111,microphone 113, touch screen 112, display controller 156, contact module130, graphics module 132, and text input module 134, the telephonemodule 138 may be used to enter a sequence of characters correspondingto a telephone number, access one or more telephone numbers in theaddress book 137, modify a telephone number that has been entered, diala respective telephone number, conduct a conversation and disconnect orhang up when the conversation is completed. As noted above, the wirelesscommunication may use any of a plurality of communications standards,protocols and technologies.

In conjunction with RF circuitry 108, audio circuitry 110, speaker 111,microphone 113, touch screen 112, display controller 156, optical sensor164, optical sensor controller 158, contact module 130, graphics module132, text input module 134, contact list 137, and telephone module 138,the videoconferencing module 139 may be used to initiate, conduct, andterminate a video conference between a user and one or more otherparticipants.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact module 130, graphics module 132, and text inputmodule 134, the e-mail client module 140 may be used to create, send,receive, and manage e-mail. In conjunction with image management module144, the e-mail module 140 makes it very easy to create and send e-mailswith still or video images taken with camera module 143.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact module 130, graphics module 132, and text inputmodule 134, the instant messaging module 141 may be used to enter asequence of characters corresponding to an instant message, to modifypreviously entered characters, to transmit a respective instant message(for example, using a Short Message Service (SMS) or Multimedia MessageService (MMS) protocol for telephony-based instant messages or usingXMPP, SIMPLE, or IMPS for Internet-based instant messages), to receiveinstant messages and to view received instant messages. In someembodiments, transmitted and/or received instant messages may includegraphics, photos, audio files, video files and/or other attachments asare supported in a MMS and/or an Enhanced Messaging Service (EMS). Asused herein, “instant messaging” refers to both telephony-based messages(e.g., messages sent using SMS or MMS) and Internet-based messages(e.g., messages sent using XMPP, SIMPLE, or IMPS).

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact module 130, graphics module 132, text inputmodule 134, GPS module 135, map module 154, and music player module 146,the workout support module 142 may be used to create workouts (e.g.,with time, distance, and/or calorie burning goals); communicate withworkout sensors (sports devices); receive workout sensor data; calibratesensors used to monitor a workout; select and play music for a workout;and display, store and transmit workout data.

In conjunction with touch screen 112, display controller 156, opticalsensor(s) 164, optical sensor controller 158, contact module 130,graphics module 132, and image management module 144, the camera module143 may be used to capture still images or video (including a videostream) and store them into memory 102, modify characteristics of astill image or video, or delete a still image or video from memory 102.

In conjunction with touch screen 112, display controller 156, contactmodule 130, graphics module 132, text input module 134, and cameramodule 143, the image management module 144 may be used to arrange,modify (e.g., edit), or otherwise manipulate, label, delete, present(e.g., in a digital slide show or album), and store still and/or videoimages.

In conjunction with touch screen 112, display controller 156, contactmodule 130, graphics module 132, audio circuitry 110, and speaker 111,the video player module 145 may be used to display, present or otherwiseplay back videos (e.g., on the touch screen or on an external, connecteddisplay via external port 124).

In conjunction with touch screen 112, display system controller 156,contact module 130, graphics module 132, audio circuitry 110, speaker111, RF circuitry 108, and browser module 147, the music player module146 allows the user to download and play back recorded music and othersound files stored in one or more file formats, such as MP3 or AACfiles. In some embodiments, the device 100 may include the functionalityof an MP3 player, such as an iPod (trademark of Apple Computer, Inc.).

In conjunction with RF circuitry 108, touch screen 112, display systemcontroller 156, contact module 130, graphics module 132, and text inputmodule 134, the browser module 147 may be used to browse the Internet,including searching, linking to, receiving, and displaying web pages orportions thereof, as well as attachments and other files linked to webpages.

In conjunction with RF circuitry 108, touch screen 112, display systemcontroller 156, contact module 130, graphics module 132, text inputmodule 134, e-mail module 140, and browser module 147, the calendarmodule 148 may be used to create, display, modify, and store calendarsand data associated with calendars (e.g., calendar entries, to do lists,etc.).

In conjunction with RF circuitry 108, touch screen 112, display systemcontroller 156, contact module 130, graphics module 132, text inputmodule 134, and browser module 147, the widget modules 149 arcmini-applications that may be downloaded and used by a user (e.g.,weather widget 149-1, stocks widget 149-2, calculator widget 149-3,alarm clock widget 149-4, and dictionary widget 149-5) or created by theuser (e.g., user-created widget 149-6). In some embodiments, a widgetincludes an HTML (Hypertext Markup Language) file, a CSS (CascadingStyle Sheets) file, and a JavaScript file. In some embodiments, a widgetincludes an XML (Extensible Markup Language) file and a JavaScript file(e.g., Yahoo! Widgets).

In conjunction with RF circuitry 108, touch screen 112, display systemcontroller 156, contact module 130, graphics module 132, text inputmodule 134, and browser module 147, the widget creator module 150 may beused by a user to create widgets (e.g., turning a user-specified portionof a web page into a widget).

In conjunction with touch screen 112, display system controller 156,contact module 130, graphics module 132, and text input module 134, thesearch module 151 may be used to search for text, music, sound, image,video, and/or other files in memory 102 that match one or more searchcriteria (e.g., one or more user-specified search terms). In someembodiments, searching is performed as described in U.S. patentapplication Ser. No. 12/400,763, “Search Capability Implementation for aDevice,” filed Mar. 9, 2009, which is incorporated by reference hereinin its entirety.

In conjunction with touch screen 112, display controller 156, contactmodule 130, graphics module 132, and text input module 134, the notesmodule 153 may be used to create and manage notes, to do lists, and thelike.

In conjunction with RF circuitry 108, touch screen 112, display systemcontroller 156, contact module 130, graphics module 132, text inputmodule 134, GPS module 135, and browser module 147, the map module 154may be used to receive, display, modify, and store maps and dataassociated with maps (e.g., driving directions; data on stores and otherpoints of interest at or near a particular location; and otherlocation-based data).

In conjunction with touch screen 112, display system controller 156,contact module 130, graphics module 132, audio circuitry 110, speaker111, RF circuitry 108, text input module 134, e-mail client module 140,and browser module 147, the online video module 155 allows the user toaccess, browse, receive (e.g., by streaming and/or download), play back(e.g., on the touch screen or on an external, connected display viaexternal port 124), send an e-mail with a link to a particular onlinevideo, and otherwise manage online videos in one or more file formats,such as H.264. In some embodiments, instant messaging module 141, ratherthan e-mail client module 140, is used to send a link to a particularonline video. Additional description of the online video application canbe found in U.S. Provisional Patent Application No. 60/936,562,“Portable Multifunction Device, Method, and Graphical User Interface forPlaying Online Videos,” filed Jun. 20, 2007, and U.S. patent applicationSer. No. 11/968,067, “Portable Multifunction Device, Method, andGraphical User Interface for Playing Online Videos,” filed Dec. 31,2007, the content of which is hereby incorporated by reference in itsentirety.

Each of the above identified modules and applications correspond to aset of executable instructions for performing one or more functionsdescribed above and the methods described in this application (e.g., thecomputer-implemented methods and other information processing methodsdescribed herein). These modules (i.e., sets of instructions) need notbe implemented as separate software programs, procedures or modules, andthus various subsets of these modules may be combined or otherwisere-arranged in various embodiments. For example, video player module 145may be combined with music player module 146 into a single module (e.g.,video and music player module 152, FIG. 1B). In some embodiments, memory102 may store a subset of the modules and data structures identifiedabove. Furthermore, memory 102 may store additional modules and datastructures not described above.

In some embodiments, the device 100 is a device where operation of apredefined set of functions on the device is performed exclusivelythrough a touch screen 112 and/or a touchpad. By using a touch screenand/or a touchpad as the primary input/control device for operation ofthe device 100, the number of physical input/control devices (such aspush buttons, dials, and the like) on the device 100 may be reduced.

The predefined set of functions that may be performed exclusivelythrough a touch screen and/or a touchpad include navigation between userinterfaces. In some embodiments, the touchpad, when touched by the user,navigates the device 100 to a main, home, or root menu from any userinterface that may be displayed on the device 100. In such embodiments,the touchpad may be referred to as a “menu button.” In some otherembodiments, the menu button may be a physical push button or otherphysical input/control device instead of a touchpad.

FIG. 2 illustrates a portable multifunction device 100 having a touchscreen 112 in accordance with some embodiments. The touch screen maydisplay one or more graphics within user interface (UI) 200. In thisembodiment, as well as others described below, a user may select one ormore of the graphics by making contact or touching the graphics, forexample, with one or more fingers 202 (not drawn to scale in thefigure). In some embodiments, selection of one or more graphics occurswhen the user breaks contact with the one or more graphics. In someembodiments, the contact may include a gesture, such as one or moretaps, one or more swipes (from left to right, right to left, upwardand/or downward) and/or a rolling of a finger (from right to left, leftto right, upward and/or downward) that has made contact with the device100. In some embodiments, inadvertent contact with a graphic may notselect the graphic. For example, a swipe gesture that sweeps over anapplication icon may not select the corresponding application when thegesture corresponding to selection is a tap.

The device 100 may also include one or more physical buttons, such as“home” or menu button 204. As described previously, the menu button 204may be used to navigate to any application 136 in a set of applicationsthat may be executed on the device 100. Alternatively, in someembodiments, the menu button is implemented as a soft key in a GUI intouch screen 112.

In one embodiment, the device 100 includes a touch screen 112, a menubutton 204, a push button 206 for powering the device on/off and lockingthe device, volume adjustment button(s) 208, a Subscriber IdentityModule (SIM) card slot 210, a head set jack 212, and a docking/chargingexternal port 124. The push button 206 may be used to turn the poweron/off on the device by depressing the button and holding the button inthe depressed state for a predefined time interval; to lock the deviceby depressing the button and releasing the button before the predefinedtime interval has elapsed; and/or to unlock the device or initiate anunlock process. In an alternative embodiment, the device 100 also mayaccept verbal input for activation or deactivation of some functionsthrough the microphone 113.

FIG. 3 is a block diagram of an exemplary multifunction device with adisplay and a touch-sensitive surface in accordance with someembodiments. Device 300 need not be portable. In some embodiments, thedevice 300 is a laptop computer, a desktop computer, a table computer, amultimedia player device, a navigation device, an educational device(such as a child's learning toy), a gaming system, or a control device(e.g., a home or industrial controller). The device 300 typicallyincludes one or more processing units (CPU's) 310, one or more networkor other communications interfaces 360, memory 370, and one or morecommunication buses 320 for interconnecting these components. Thecommunication buses 320 may include circuitry (sometimes called achipset) that interconnects and controls communications between systemcomponents. The device 300 includes an input/output (I/O) interface 330comprising a display 340, which in some embodiments is a touch screendisplay 112. The I/O interface 330 also may include a keyboard and/ormouse (or other pointing device) 350 and a touchpad 355. Memory 370includes high-speed random access memory, such as DRAM, SRAM, DDR RAM orother random access solid state memory devices; and may includenon-volatile memory, such as one or more magnetic disk storage devices,optical disk storage devices, flash memory devices, or othernon-volatile solid state storage devices. Memory 370 may optionallyinclude one or more storage devices remotely located from the CPU(s)310. In some embodiments, memory 370 stores programs, modules, and datastructures analogous to the programs, modules, and data structuresstored in the memory 102 of portable multifunction device 100 (FIG. 1),or a subset thereof. Furthermore, memory 370 may store additionalprograms, modules, and data structures not present in the memory 102 ofportable multifunction device 100. For example, memory 370 of device 300may store drawing module 380, presentation module 382, word processingmodule 384, website creation module 386, disk authoring module 388,and/or spreadsheet module 390, while memory 102 of portablemultifunction device 100 (FIG. 1) may not store these modules.

Each of the above identified elements in FIG. 3 may be stored in one ormore of the previously mentioned memory devices. Each of the aboveidentified modules corresponds to a set of instructions for performing afunction described above. The above identified modules or programs(i.e., sets of instructions) need not be implemented as separatesoftware programs, procedures or modules, and thus various subsets ofthese modules may be combined or otherwise re-arranged in variousembodiments. In some embodiments, memory 370 may store a subset of themodules and data structures identified above. Furthermore, memory 370may store additional modules and data structures not described above.

Attention is now directed towards embodiments of user interfaces (“UR”)that may be implemented on a portable multifunction device 100.

FIGS. 4A and 4B illustrate exemplary user interfaces for a menu ofapplications on a portable multifunction device 100 in accordance withsome embodiments. Similar user interfaces may be implemented on device300. In some embodiments, user interface 400A includes the followingelements, or a subset or superset thereof:

-   -   Signal strength indicator(s) 402 for wireless communication(s),        such as cellular and Wi-Fi signals;    -   Time 404;    -   Bluetooth indicator 405;    -   Battery status indicator 406;    -   Tray 408 with icons for frequently used applications, such as:        -   Phone 138, which may include an indicator 414 of the number            of missed calls or voicemail messages;        -   E-mail client 140, which may include an indicator 410 of the            number of unread e-mails;        -   Browser 147; and        -   Music player 146; and    -   Icons for other applications, such as:        -   IM 141;        -   Image management 144;        -   Camera 143;        -   Video player 145;        -   Weather 149-1;        -   Stocks 149-2;        -   Workout support 142;        -   Calendar 148;        -   Calculator 149-3;        -   Alarm clock 149-4;        -   Dictionary 149-5; and        -   User-created widget 149-6.

In some embodiments, user interface 400B includes the followingelements, or a subset or superset thereof:

-   -   402, 404, 405, 406, 141, 148, 144, 143, 149-3, 149-2, 149-1,        149-4, 410, 414, 138, 140, and 147, as described above;    -   Map 154;    -   Notes 153;    -   Settings 412, which provides access to settings for the device        100 and its various applications 136, as described further        below;    -   Video and music player module 152, also referred to as iPod        (trademark of Apple Computer, Inc.) module 152; and    -   Online video module 155, also referred to as YouTube (trademark        of Google, Inc.) module 155.

Attention is now directed towards embodiments of user interfaces (“UI”)and associated processes that may be implemented on a computing devicewith a display and a touch-sensitive surface, such as device 300 orportable multifunction device 100.

FIGS. 5A-5Y illustrate exemplary user interfaces for performingintegrated searches and accessing data associated with a plurality ofapplications in accordance with some embodiments. The user interfaces inthese figures are used to illustrate the processes described below withrespect to FIGS. 6A-6K.

FIGS. 5A-5G illustrate user interfaces for initially displaying aplurality of application launch icons and displaying a search inputinterface. FIGS. 5A-5C illustrate a plurality of application launchicons 5002, 5004, 5006, 5008 and user gestures to initiate display of asearch input interface (e.g., 5030 in FIG. 5B; 5032, 5034 in FIG. 5C; or5044, 5046 in FIG. 5G). FIGS. 5D-5E illustrate an animated transitionfrom the plurality of launch icons to a search input interface. FIG. 5Fillustrates the search input interface 5037.

FIGS. 5H-5K illustrate performing a search using the search inputinterface. FIG. 5H illustrates entering search input 5048 into a searchinput area 5048 using a soft keyboard. FIG. 5I illustrates displayingsearch results in accordance with some embodiments. FIGS. 5I-5Killustrate scrolling through search results in response to user input(e.g., 5056, 5058 in FIG. 5I).

FIGS. 5L-5N illustrate changing the order in which respective searchresults subsets are displayed in response to user input using one ormore settings pages.

FIGS. 5O-5R illustrate detecting a selection of a search resultassociated with a first application, displaying the first applicationand information associated with the search result, and returning to thesearch results. FIG. 5O illustrates detecting user selection 5094 of asearch result 5092-2. FIG. 5P illustrates an animated transition betweenthe search results and the first application. FIG. 5Q illustratesdisplaying the first application 5106 along with information (e.g.,5100, 5102, 5104 in FIG. 5Q) corresponding to the selected searchresult. FIG. 5R illustrates a transition between the first applicationand the search results.

FIGS. 5S-5V illustrate detecting a selection of a search resultassociated with a second application, displaying the second applicationand information associated with the search result, and returning to thesearch results. FIG. 5S illustrates detecting user selection 5114 of asearch result 5092-7. FIG. 5T illustrates an animated transition betweenthe search result and the second application. FIG. 5U illustratesdisplaying the second application 5126 along with information (e.g.,5120, 5122, 5124 in FIG. 5U) corresponding to the selected searchresult. FIG. 5V illustrates a transition between the second applicationand the search results.

FIGS. 5W-5Y illustrate ceasing to display the search results anddisplaying the application launch icons. FIG. 5W illustrates detectingan input (e.g., 5134, 5136 in FIG. 5W) while displaying the searchresults. FIGS. 5W and 5Y illustrate an animated transition between thesearch results (e.g., 5092-1, 5092-2, 5092-3, 5092-4, 5092-5, 5092-6,5092-7 in FIG. 5X) and the application launch icons (e.g., 5002, 5004 inFIG. 5Y).

FIGS. 6A-6K are flow diagrams illustrating a method for performingintegrated searches and accessing data associated with a plurality ofapplications in accordance with some embodiments. The method 600 isperformed at a multifunction device (e.g., 300, FIG. 3) with a displayand a touch-sensitive surface. Some operations in method 600 may becombined and/or the order of some operations may be changed.

In some embodiments, the touch-sensitive surface is on the display. Inother words, the display is a touch screen display (e.g., 112, FIG. 2).In some embodiments, the method is performed at a portable multifunctiondevice with a touch screen display (e.g., portable multifunction device100).

As described below, the method 600 provides a way to perform integratedsearches and provide access to a plurality of applications, using adisplay and a touch-sensitive surface. The method reduces the cognitiveburden on a user when performing searches and using applications on themultifunction device, thereby creating a more efficient human-machineinterface. For battery-operated computing devices, enabling a user toperform searches faster and more efficiently conserves power andincreases the time between battery charges.

The device concurrently displays (602) a first plurality of applicationlaunch icons (e.g., 5002, 5004, 5006 and 5008 in FIG. 5A) in a firstarea (e.g., 5010 in FIG. 5A) of the touch screen display. In someembodiments, the device also displays a second plurality of applicationlaunch icons (e.g., 5009-1, 5009-2, 5009-3, and 5009-4 in FIG. 5A) in asecond area (e.g., 5012 in FIG. 5A) on the touch screen display, whereinthe second area is different from the first area.

In some embodiments, the first plurality of application launch icons(e.g., 5002, 5004, 5006 and 5008 in FIG. 5A) is (603) a first set ofapplication launch icons that corresponds to a first set of applicationsin the plurality of applications. In some embodiments, a plurality ofsets of application launch icons includes (604) a number of sets ofapplication launch icons that are configured to be separately displayedas a sequence of sets (e.g., a first set includes 5002, 5004, 5006 and5008 in FIG. 5A; and a second set includes 5022, 5024, 5026 and 5028 inFIG. 5B) of application launch icons in the first area (e.g., 5010 inFIG. 5A) of the touch screen display. In some embodiments, the devicedisplays (605) two or more set-sequence-indicia icons (e.g., 5014-1 and5014-2 in FIG. 5A). In some embodiments, the set-sequence-indicia iconsprovide (606) information about the number of sets of application launchicons in the plurality of sets of application launch icons and aposition of a displayed set of application launch icons in the sequenceof sets of application launch icons. For example, in some embodiments,if there are two set sequence indicia icons, there are two sets oficons. In some embodiments, the device displays (607) a search indiciaicon (e.g., 5016 in FIG. 5A) adjacent to a set-sequence-indicia iconthat corresponds to the first set of application launch icons.

In some embodiments, the device detects (608) a finger gesture on thetouch screen display in the first area (e.g., a finger swipe gesturesuch as a contact 5018 in FIG. 5A and a right-to-left finger swipe 5020in FIG. 5A). In some embodiments, in response (609) to detecting thefinger gesture on the touch screen display in the first area, the devicereplaces (610) display of the first set of application launch icons withdisplay of a second set of application launch icons (e.g., 5022, 5024,5026 and 5028 in FIG. 5B) in the first area on the touch screen display.

In some embodiments, in response to detecting the finger gesture on thetouch screen display in the first area, the device updates (611) theinformation provided by the set-sequence-indicia icons to reflect thereplacement of the displayed first set of application launch icons bythe second set of application launch icons. For example theset-sequence-indicia icon that corresponds to the current set ofapplication launch icons may be highlighted (e.g., the left mostset-sequence-indicia icon 5014-2 in FIG. 5A or the right mostset-sequence-indicia icon 5014-2 in FIG. 5B). In some embodiments, inresponse to detecting the finger gesture (e.g., 5020 in FIG. 5A) on thetouch screen display in the first area (e.g., 5010 in FIG. 5A), thedevice replaces display of the first set of application launch icons(e.g., 5002, 5004, 5006 and/or 5008 in FIG. 5A) with display of a secondset of application launch icons (e.g., 5022, 5024, 5026 and 5028 in FIG.5B) in the first area (e.g., 5010 in FIG. 5B) on the touch screendisplay, updates the information provided by the set-sequence-indiciaicons (e.g., 5014-2 is highlighted), and maintains the display of thesecond plurality of application launch icons in the second area on thetouch screen display.

In some embodiments, while displaying the second set of applicationlaunch icons in the first area on the touch screen display, the devicedetects (612) an input by the user (e.g., activation of a physicalbutton such as a home menu button or a soft menu button by a singleclick). For example in FIG. 5B, the device detects a contact 5030 with ahome button 204 and in response (613) to detecting the input by theuser, the device ceases (614) to display the second set of applicationlaunch icons (e.g., the device displays a search input user interface,as illustrated in FIG. 5F). In some embodiments, while displaying thefirst plurality of launch icons the device detects a finger gesture onthe touch screen display in the first area (e.g., a finger swipe gesturesuch as a contact 5032 in FIG. 5C and a left-to-right finger swipe 5034in FIG. 5C).

In some embodiments, the device displays (615) an animation of atransition from display of the first plurality of application launchicons to display of the search input user interface (e.g., the animationillustrated sequentially in FIGS. 5C, 5D, 5E and 5F). In someembodiments, this animation is also displayed when the device isdisplaying a second set of application launch icons and detects an inputby the user (e.g., 5030 in FIG. 5B). In some embodiments, the animationcomprises (616) sliding the search input user interface (e.g., 5037 inFIG. 5D) onto the touch screen display from a side of the display (e.g.,5036 in FIG. 5D). In some embodiments, the animation comprises (617)sliding the first plurality of application launch icons (e.g., 5002,5004 and 5006 in FIG. 5D) towards a side of the display (e.g., 5038 inFIG. 5D). In some embodiments, the animation comprises (618) sliding thesearch input user interface (e.g., 5037 in FIG. 5D) onto the touchscreen display from a first side of the display while concurrentlysliding the first plurality of application launch icons towards a secondside of the display opposite the first side of the display (e.g., asshown in FIGS. 5D, 5E and 5F). In some embodiments the animationincludes sliding the search input user interface (e.g., 5037 in FIG. 5G)onto the screen from the top of the screen while sliding the pluralityof application launch icons towards a bottom of the screen afterdetecting a user gesture (e.g., contact 5041 and downward swipe 5043 inFIG. 5G).

In some embodiments the device displays (619) a search input userinterface (5037 in FIG. 5F or 5037 in FIG. 5G) on the touch screendisplay. In some embodiments, the search input user interface comprises(620) the search input area (e.g., 5040 in FIG. 5F) and a soft keyboard(e.g., 5042 in FIG. 5F).

The device detects (621) a first input by a user. For example, the inputmay be a finger gesture, such as a left-to-right finger swipe gesture(e.g., 5034 in FIG. 5C), a vertically downward swipe gestures (e.g.,contact 5041 in FIG. 5G and detected downward movement 5043 in FIG. 5G),or other predefined user action on the touch screen display in the firstarea. In response (622) to detecting the first input by the user, thedevice displays (623) a search input area (e.g., 5040 in FIG. 5F or 5040in FIG. 5G) on the touch screen display. In some embodiments, inresponse to detecting the first input by the user on the touch screendisplay in the first area, the device replaces (624) display of thefirst plurality of application launch icons with display of a searchinput user interface (e.g., 5037 in FIGS. 5F and 5G) on the touch screendisplay. In some embodiments, the search input user interface includes(625) the search input area (e.g., 5040 in FIGS. 5F and 5G). In someembodiments, a keyboard (e.g., 5042 in FIG. 5F) is displayed when thedevice detects a contact in the search input area (e.g., 5040 in FIG.5G).

The device receives (626) search input from the user (e.g., detectingfinger tap gestures on text characters and other symbols in a softkeyboard). For example, in FIG. 5H, the device detects input including afirst contact 5044 with the letter “s” and a second contact 5046 withthe letter “u.” The device displays (627) the search input on the touchscreen display (e.g., the letters “su” arc displayed in the search inputarea 5040, FIG. 5H).

The device performs (628) a search using the search input. In someembodiments, searching is performed as described in U.S. patentapplication Ser. No. 12/400,763, “Search Capability Implementation for aDevice,” filed Mar. 9, 2009, which is incorporated by reference hereinin its entirety. In some embodiments, performing the search comprises(629) real-time filtering of search results across the plurality ofapplications as search input characters are received from the user. Forexample, the device performs real-time filtering as search characters(e.g., “su” 5048 in FIG. 5H) are entered. For example in FIG. 5H,results matching the search characters (e.g., “Claire GaiaRoseSunSpiral” 5050-1, “Kiji Sushi Bar and Cuisine” 5050-2, “VytasSunSpiral” 5050-3 and “Random Summer” 5050-4) are displayed. In someembodiments, when contact (e.g., 5052 in FIG. 5H) is detected on regionof the touch screen display that corresponds to a “search” button (e.g.,5054 in FIG. 5H) a full search is performed. In some embodiments, whencontact (e.g., 5052 in FIG. 5H) is detected on region of the touchscreen display that corresponds to a “search” button (e.g., 5054 in FIG.5H) the keyboard 5042 is hidden (as shown in FIG. 5I), and additionalresults (e.g., 5050-5, 5050-6, 5050-7 in FIG. 5I) are displayed.

The device displays (630) a plurality of search results (e.g., 5050-1,5050-2, 5050-3, 5050-4, 5050-6, 5050-7 in FIG. 5I) from the search onthe touch screen display. In some embodiments, the search indicia icon(e.g., 5016 in FIG. 5I) is highlighted when the search user interface isdisplayed. In some embodiments, displaying the plurality of searchresults comprises displaying (631) a list of search results (e.g.,5050-1 through 5050-7 in FIG. 5I), wherein the list of search resultsare configured (632) to scroll in response to detection of a fingerswipe gesture (e.g., contact 5056 and upward swipe 5058 in FIG. 5I) onthe list of search results.

In some embodiments, the device displays (633) search results in theplurality of search results in a list. In some embodiments, the listgroups (634) subsets of search results by application. For example, inFIG. 5I the top three results in the list “Claire GaiaRose SunSpiral”5050-1, “Kiji Sushi Bar and Cuisine” 5050-2 and “Vytas SunSpiral” 5050-3arc all contacts of the user and arc associated with the address bookapplication; the bottom four results “Random Summer 5050-4, “BrownsvilleTurnaround” 5050-5, “Pulling out of Ricardo” 5050-6, and “Six Hours toLouisiana” 5050-7 are media content and are associated with a mediaplayer application. In some embodiments, the device displays (635) arespective application symbol (e.g., an address book application symbol5060 in FIG. 5I or a media player symbol 5062-1 FIG. 5I) in conjunctionwith a respective subset (e.g., the address book application symbol 5060is displayed in conjunction with the address book entries 5050-1, 5050-2and 5050-3 in FIG. 5I) of search results for a respective application.

In some embodiments, the device detects (636) a finger gesture on thetouch screen display (e.g., a finger swipe gesture such as an upwardswipe). In some embodiments, in response (637) to detecting the fingergesture (e.g., contact 5056 and upward swipe 5058 in FIG. 5I) on thetouch screen display, the device scrolls (638) the list (as shown inFIG. 5J, where “Claire GaiaRose SunSpiral” 5050-1 has moved off of thescreen, while “My Kingdom (Part I)” 5050-8 has moved onto the screen).

In some embodiments, the device moves (639) the respective applicationsymbol on the touch screen display in accordance with the respectivesubset of search results for the respective application (e.g., in FIGS.5I and 5J, the media player application symbol 5062 stays with the topmedia result “Random Summer” 5050-4 even as the list scrolls upwards).In some embodiments, the respective application symbol remains (640)adjacent to a first displayed search result of the respective subset ofsearch results for the respective application. For example, in FIG. 5I,“Claire GaiaRose SunSpiral” 5050-1 was the first displayed contact andthe address book application symbol 5060 was adjacent to “ClaireGaiaRose SunSpiral” 5050-1. In FIG. 5J “Claire GaiaRose SunSpiral”5050-1 has moved off the screen and “Kiji Sushi Bar and Cuisine” 5050-2is the first displayed search result of the respective subset ofcontacts, and thus the address book application symbol 5060 is displayedadjacent to “Kiji Sushi Bar and Cuisine” 5050-2.

In some embodiments, in response to detecting an upward swipe on thetouch screen display, the device moves (641) the respective applicationsymbol from a lower edge of a window to an upper edge of the window andmaintains display of the respective application symbol at the upper edgeof the window until an end of the respective subset of search resultsfor the respective application is reached. For example, in FIGS. 5I and5J, the address book application symbol 5060 is displayed at the top ofthe screen, however when the last result “Vytas SunSpiral” 5050-3 in thesubset that is associated with the address book application symbol 5060scrolls off the screen (as shown in FIG. 5K), the address bookapplication symbol 5060 also scrolls off the screen, and is replaced bythe media player application symbol 5062. Although address bookapplication symbol 5060 was used in this example, it should beunderstood that in some embodiments, a similar operation is performed toone or more additional application symbols as the subset of resultsassociated with the application symbol scroll off of the screen.

In some embodiments, the device sets (642) an order in which respectivesearch results subsets are displayed in response to user input. In someembodiments, the device may be configured (e.g., with a settings page)such that search results for some applications are not displayed. Forexample, the device detects input (e.g., contacts 5064, 5066 and 5068 inFIG. 5L) with the touch screen display that indicates that the searchresults associated with those subsets are not to be displayed. Forexample, in FIG. 5N applications 5086, podcasts 5088, video 5090 searchresults have been selected to not be displayed at all. In someembodiments, the user may configure the order in which respective searchresults subsets are displayed by application, and even whetherrespective search results are displayed. For example, as illustrated inFIGS. 5L-5N, a setting page may be used to set the order in which searchresult subsets are displayed. In some embodiments, the device detectsinput (e.g., contact 5070 and upward swipe 5072 in FIG. 5M) with thetouch screen display that indicates the order in which the subsets areto be displayed. For example, in FIG. 5N the device is configured suchthat music 5074 search results displayed first, contacts 5076 searchresults displayed second, mail 5078 search results displayed third,audio books 5080 search results displayed fourth, notes 5082 searchresults displayed fifth and calendar 5084 search results displayedsixth.

The device detects (643) user selection of a first search result in theplurality of search results (e.g., a finger gesture, such as a tapgesture or other predefined user action on the first search result). Forexample, in FIG. 5O, the device detects a tap gesture (e.g., contact5094 on “Kiji Sushi Bar and Cuisine” 5092-2 in FIG. 5O). The firstsearch result (e.g., contact 5094 on “Kiji Sushi Bar and Cuisine” 5092-2in FIG. 5O) corresponds (644) to content associated with a firstapplication (e.g., an address book application).

In response (645) to detecting user selection (e.g., contact 5094 inFIG. 5O) of the first search result in the plurality of search results,the device ceases (646) to display of the plurality of search results.In some embodiments, the device displays (647) an animation of atransition from display of the plurality of search results to display ofthe information corresponding to the first search result in thecorresponding first application. For example, representation of thesearch results (e.g., 5096 in FIG. 5P) is reduced in size (e.g., fromthe original size to half the original size) while a representation ofthe application (e.g., a representation of an address book 5098 in FIG.5P) is increased in size (e.g., from an original size to twice theoriginal size).

The device displays (648) information (e.g., a phone number 5100, awebsite 5102, and/or an address 5104 in the address book application5106 in FIG. 5Q) corresponding to the first search result (e.g., “KijiSushi Bar and Cuisine” 5092-2 in FIG. 5O) in the corresponding firstapplication (e.g., address book 5106 in FIG. 5Q). While continuing todisplay the first application (e.g., 5106 in FIG. 5Q), the devicedetects (649) a second input by the user (e.g., activation of a physicalbutton such as a home menu button 204 or a soft menu button by a singleclick or a double click). For example, the device detects a contact 5108in FIG. 5Q with a home button 204.

In response (650) to detecting the second input by the user, the deviceceases (651) to display the first application. In some embodiments, thedevice displays (652) an animation of a transition from display of thefirst application to display of the plurality of search results. Forexample, representation of the application (e.g., a representation of anaddress book 5110 in FIG. 5R) is reduced in size (e.g., from theoriginal size to half the original size) while a representation of thesearch results (e.g., 5112 in FIG. 5R) is increased in size (e.g., froman original size to twice the original size).

The device redisplays (653) the plurality of search results on the touchscreen display. In some embodiments, in response to detecting the thirdinput by the user the device, the device ceases (654) to display thefirst application and redisplaying the plurality of search results(e.g., 5092-1, 5092-2, 5092-3, 5092-4, 5092-5, 5092-6, 5092-7 in FIG.5S) on the touch screen display when the second input (e.g., contact5108 in FIG. 5Q with a home button 204) is detected before apredetermined condition has occurred. In some embodiments, the deviceceases (655) to display the first application and redisplays the firstplurality of application launch icons (e.g., 5002, 5004, 5006, 5008 inFIG. 5A) in the first area of the touch screen display when the secondinput (e.g., contact 5108 in FIG. 5Q with a home button 204) is detectedafter the predetermined condition has occurred. In some embodiments, thepredetermined condition is whether a predetermined time period haselapsed (e.g., the condition has occurred if one minute has elapsedbetween when the user selection of the first search result was detectedand when the second input was detected). In some embodiments thepredetermined condition is that a predetermined set of one or moreactions have occurred (e.g., the condition has occurred if the user hasperformed a specified number of inputs in the first application beforethe second input is detected).

The device detects (656) user selection of a second search result (e.g.,5092-6 in FIG. 5S) in the plurality of search results (e.g., a fingergesture, such as a tap gesture or other predefined user action on thesecond search result). For example, the device detects contact (e.g.,5114 with “Ape to Angel” in FIG. 5S). The second search resultcorresponds (657) to content associated with a second application (e.g.,a media player application). The second search result is (658) otherthan the first search result (e.g., “Ape to Angel” 5092-7 is not “KijiSushi Bar and Cuisine” 5092-2). The second application is (659) otherthan the first application (e.g., a media player application 5126 inFIG. 5U is not the address book application 5106 in FIG. 5Q).

In response (660) to detecting user selection of the second searchresult (e.g., “Ape to Angel” 5092-7 in FIG. 5S) in the plurality ofsearch results, the device ceases (661) to display of the plurality ofsearch results. In some embodiments, the device displays (662) ananimation of a transition from display of the plurality of searchresults to display of the information corresponding to the second searchresult in the corresponding second application. For example,representation of the search results (e.g., 5116 in FIG. 5T) is reducedin size (e.g., from the original size to half the original size) while arepresentation of the application (e.g., a representation of a mediaplayer 5118 in FIG. 5T) is increased in size (e.g., from an originalsize to twice the original size).

The device displays (663) information (e.g., song title 5120, songartist 5122, and current playback position 5124 in FIG. 5U)corresponding to the second search result (e.g., “Ape to Angel” 5092-7in FIG. 5S) in the corresponding second application (e.g., a mediaplayer 5126 in FIG. 5U). While continuing to display the secondapplication, the device detects (664) a third input by the user (e.g.,activation of a physical button such as a home menu button or a softmenu button, which may be the same action as the second input). Forexample, the device detects a contact (e.g., 5128 in FIG. 5U) with ahome button 204.

In response (665) to detecting the third input (e.g., contact 5128 inFIG. 5U) by the user, the device ceases (666) to display the secondapplication (e.g., media player 5126 in FIG. 5U). In some embodiments,the device displays (667) an animation of a transition from display ofthe second application to display of the plurality of search results.For example, representation of the application (e.g., a representationof a media player 5132 in FIG. 5V) is reduced in size (e.g., from theoriginal size to half the original size) while a representation of thesearch results (e.g., 5130 in FIG. 5V) is increased in size (e.g., froman original size to twice the original size). The device redisplays(668) the plurality of search results (e.g., 5092-1, 5092-2, 5092-3,5092-4, 5092-5, 5092-6, 5092-7 in FIG. 5W) on the touch screen display.

In some embodiments, in response to detecting the third input by theuser the device ceases (669) to display the second application andredisplaying the plurality of search results (e.g., 5092-1, 5092-2,5092-3, 5092-4, 5092-5, 5092-6, 5092-7 in FIG. 5W) on the touch screendisplay when the third input (e.g., contact 5128 in FIG. 5U with a homebutton 204) is detected before a predetermined condition has occurred.In some embodiments, the device ceases (670) to display the secondapplication and redisplaying the first plurality of application launchicons (e.g., 5002, 5004, 5006, 5008 in FIG. 5A) in the first area of thetouch screen display when the third input (e.g., contact 5128 in FIG. 5Uwith a home button 204) is detected after the predetermined conditionhas occurred. In some embodiments, the predetermined condition iswhether a predetermined time period has elapsed (e.g., the condition hasoccurred if one minute has elapsed between when the user selection ofthe first search result was detected and when the second input wasdetected). In some embodiments the predetermined condition is that apredetermined set of one or more actions have occurred (e.g., thecondition has occurred if the user has performed a specified number ofinputs in the first application before the second input is detected).

In some embodiments, after ceasing to display the second application andredisplaying the plurality of search results (e.g., 5092-1, 5092-2,5092-3, 5092-4, 5092-5, 5092-6, 5092-7 in FIG. 5W) on the touch screendisplay, the device detects (671) a fourth input by the user (e.g., afinger gesture, such as a right-to-left finger swipe gesture or otherpredefined user action) on the touch screen display in the first area.For example, in FIG. 5W, the device detects a contact 5134 and movementof the contact 5136 (e.g., a right-to-left finger swipe). In response(672) to detecting the fourth input by the user, the device ceases (673)to display the plurality of search results on the touch screen display.

In some embodiments, the device displays an animation of a transitionfrom display of the search user interface with search results to displayof the first plurality of application launch icons (e.g., the animationillustrated sequentially in FIGS. 5W, 5X, 5Y and 5A). In someembodiments, the animation comprises sliding the first plurality ofapplication launch icons (e.g., 5002 in FIG. 5X and 5002 and 5004 inFIG. 5Y) onto the touch screen display from a side of the display (e.g.,5036 in FIG. 5X). In some embodiments, the animation comprises (617)sliding the search user interface (e.g., 5037) and any search results(e.g., 5092-1, 5092-2, 5092-3, 5092-4, 5092-5, 5092-6. 5092-7 in FIG.5X) towards a side of the display (e.g., 5038 in FIG. 5X). In someembodiments, the animation comprises (618) sliding the first pluralityof application icons (e.g., 5002, in FIG. 5X and 5002 in FIG. 5Y) ontothe touch screen display from a first side of the display whileconcurrently sliding the first plurality of application launch iconstowards a second side of the display opposite the first side of thedisplay (e.g., as shown in FIGS. 5X and 5Y).

In some embodiments, after detecting the fourth input by the user (e.g.,contact 5134 and movement of the contact 5136 in FIG. 5W) the devicedisplays (674) the first plurality of application launch icons (e.g.,5002, 5004, 5006, 5008 in FIG. 5A) in the first area (e.g., 5010 in FIG.5A) of the touch screen display.

The steps in the information processing methods described above may beimplemented by running one or more functional modules in informationprocessing apparatus such as general purpose processors or applicationspecific chips. These modules, combinations of these modules, and/ortheir combination with general hardware (e.g., as described above withrespect to FIGS. 1A, 1B and 3) are all included within the scope ofprotection of the invention.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussions above are not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Many modificationsand variations are possible in view of the above teachings. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, to therebyenable others skilled in the art to best utilize the invention andvarious embodiments with various modifications as are suited to theparticular use contemplated.

What is claimed is:
 1. An electronic device, comprising: a display; atouch-sensitive surface; one or more processors; and memory storing oneor more programs configured to be executed by the one or moreprocessors, the one or more programs including instructions for:displaying a first page of a multi-page application launch interfacethat includes multiple pages of application icons for launching distinctapplications, wherein the first page includes a first plurality ofapplication icons; while displaying the first page of the multi-pageapplication launch interface, detecting, on the touch-sensitive surface,a first input that includes detecting a first contact and detectingmovement of the first contact on the touch-sensitive surface; and inresponse to detecting the first input on the touch-sensitive surface: inaccordance with a determination that the first input meets next-pagedisplay criteria, wherein the next-page display criteria include acriterion that is met when the first contact moves in a firstpredetermined direction on the touch-sensitive surface, replacingdisplay of the first page of the multi-page application launch interfacewith display of a second page of the multi-page application launchinterface that includes a second plurality of application icons that aredifferent from the first plurality of application icons; and inaccordance with a determination that the first input meetssearch-interface display criteria, wherein the search-interface displaycriteria include a criterion that is met when the first contact moves ina second predetermined direction that is perpendicular to the firstdirection, displaying a search interface that includes a search inputfield for inputting search terms.
 2. The electronic device of claim 1,wherein displaying the search interface includes displaying a keyboardfor entering text into the search input field.
 3. The electronic deviceof claim 1, wherein displaying the search interface includes:translating a set of application icons from the first page away from arespective edge of the display in the second predefined direction; anddisplaying the search input field in between a respective edge of thedisplay and the application icons.
 4. The electronic device of claim 1,wherein displaying the search interface includes ceasing to display atleast a subset of the application icons on the first page.
 5. Theelectronic device of claim 1, wherein the one or more programs furtherincluding instructions for: in response to detecting the first input,maintaining display of one or more of the application icons from thefirst page of the multi-page user interface while displaying the searchinterface.
 6. The electronic device of claim 1, wherein: the multi-pageapplication launch interface includes a fixed icon region that includesa plurality of application icons, and the fixed icon region isconcurrently displayed with each page of the multiple pages ofapplication icons; and the one or more programs further includeinstructions for: displaying the search interface in response todetecting the first input includes ceasing to display the fixed iconregion.
 7. The electronic device of claim 1, wherein the one or moreprograms further including instructions for: while displaying the searchinput field: receiving text input in the search input field; retrievingsearch results that correspond to the text input; and displaying one ormore of the retrieved search results on the display.
 8. A methodcomprising: at an electronic device that includes a display and atouch-sensitive surface: displaying a first page of a multi-pageapplication launch interface that includes multiple pages of applicationicons for launching distinct applications, wherein the first pageincludes a first plurality of application icons; while displaying thefirst page of the multi-page application launch interface, detecting, onthe touch-sensitive surface, a first input that includes detecting afirst contact and detecting movement of the first contact on thetouch-sensitive surface; and in response to detecting the first input onthe touch-sensitive surface: in accordance with a determination that thefirst input meets next-page display criteria, wherein the next-pagedisplay criteria include a criterion that is met when the first contactmoves in a first predetermined direction on the touch-sensitive surface,replacing display of the first page of the multi-page application launchinterface with display of a second page of the multi-page applicationlaunch interface that includes a second plurality of application iconsthat are different from the first plurality of application icons; and inaccordance with a determination that the first input meetssearch-interface display criteria, wherein the search-interface displaycriteria include a criterion that is met when the first contact moves ina second predetermined direction that is perpendicular to the firstdirection, displaying a search interface that includes a search inputfield for inputting search terms.
 9. The method of claim 8, whereindisplaying the search interface includes displaying a keyboard forentering text into the search input field.
 10. The method of claim 8,wherein displaying the search interface includes: translating a set ofapplication icons from the first page away from a respective edge of thedisplay in the second predefined direction; and displaying the searchinput field in between a respective edge of the display and theapplication icons.
 11. The method of claim 8, wherein displaying thesearch interface includes ceasing to display at least a subset of theapplication icons on the first page.
 12. The method of claim 8, whereinthe one or more programs further including instructions for: in responseto detecting the first input, maintaining display of one or more of theapplication icons from the first page of the multi-page user interfacewhile displaying the search interface.
 13. The method of claim 8,wherein: the multi-page application launch interface includes a fixedicon region that includes a plurality of application icons, and thefixed icon region is concurrently displayed with each page of themultiple pages of application icons; and the one or more programsfurther include instructions for: displaying the search interface inresponse to detecting the first input includes ceasing to display thefixed icon region.
 14. The method of claim 8, wherein the one or moreprograms further including instructions for: while displaying the searchinput field: receiving text input in the search input field; retrievingsearch results that correspond to the text input; and displaying one ormore of the retrieved search results on the display.
 15. Anon-transitory computer-readable storage medium storing one or moreprograms configured to be executed by one or more processors of anelectronic device with a display and a touch-sensitive surface, the oneor more programs including instructions for: displaying a first page ofa multi-page application launch interface that includes multiple pagesof application icons for launching distinct applications, wherein thefirst page includes a first plurality of application icons; whiledisplaying the first page of the multi-page application launchinterface, detecting, on the touch-sensitive surface, a first input thatincludes detecting a first contact and detecting movement of the firstcontact on the touch-sensitive surface; and in response to detecting thefirst input on the touch-sensitive surface: in accordance with adetermination that the first input meets next-page display criteria,wherein the next-page display criteria include a criterion that is metwhen the first contact moves in a first predetermined direction on thetouch-sensitive surface, replacing display of the first page of themulti-page application launch interface with display of a second page ofthe multi-page application launch interface that includes a secondplurality of application icons that are different from the firstplurality of application icons; and in accordance with a determinationthat the first input meets search-interface display criteria, whereinthe search-interface display criteria include a criterion that is metwhen the first contact moves in a second predetermined direction that isperpendicular to the first direction, displaying a search interface thatincludes a search input field for inputting search terms.